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ABSTRACT - 

Program planning and impleiheritation surveys were 

completed by 128 teachers of learning di sabled/ students |n 42 states. 
Seven reseatch questions relating to the relationship between teacher 
61.^ student characteristics and decision behavior were addressed 
through chi-square analyses or one-way analyses of variance, it was 
found that the types of information Used in making decisions were _ 
differentially related to the kinds of decisions made. Except for the 
finding that teachers who relied on test-based information in ongoing 

evaluations were more likely to make program changes than^were 

teachers who used observational information^ no relationships were 
found between teachar characteristics and specific decisions or 
factors influencing decisions. Likewise, specific student _ 
characteristics were riot fourid to be useful predictors of decision 
behavior. Implicatioris for gudging effective teachirig^aridiricrfeasing 
effectiveness are discussed. Appended are a program planning and 
implementation survey and a section on categorization of data. 
(Author) 
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Abstract 

Pregram planning and implementation surveys were completed by 128 
teachers of learning disabled students in 42 states. Seven research 
questions relating to the relationship between teacher or student 
characteristics and decision behavior were addressed through chi= 
square analyses or one-way analyses of variance. It was found that 
the types of information used in making decisions were differentially 
related to the. kinds of decisions made. Except for the finding that 
teachers who relied bri test-based information in ongoing evaluations 
were more likely to make program changes than were teachers who used 
observational information, no relationships were found between teacher 
characteristics and specific decisions or factors influencing 
decisions. Likewise, specific student characteristics were not found 
to be useful predictors of decision behavior. Implications for 
judging effective teaching and increasing effectiveness are discussed. 



Iristruetibrial Decisibri-Making Practices of Teachers of 
beaming Disabled Students 

Examination of teacher thinking is a relatively new development 
in research on teaching. It is considered by some (Clark* 1979; 
Medley, 1979) to be the most recent approach in aLLempts to understand 
and characterize teacher effectiveness. Medley (1979) identifi3S the 
first Stage of teacher effectiveness research as brie iri which 
researchers attempted to identify the teacher personality traits arid 
characteristics believed to determine effective teaching. The riext 
stage focused on the methods of teaching beirig used. Theri 
effectiveness was perceived as beirig a product of the climate of the 
classroom and the interaction between teacher and student. Emphasis 
has rtdw shifted to some extent to viewing effective teachers as thbse 
who have mastered a repertoire of competericies arid who cari use these 
competencies efficiently and appropriately, irf other words, teachers 
who operate as professional decision makers. 

Clark (1979) describes five different approaches to research bn 
teacher eff ectiveriess--three of the approaches he terms "quaritita^ive" 
(process product, aptitude-treatment interaction, arid engaged time) 
and twb are characterized as "qualitative" approaches f ethnographic 
arid cbgnitive information processing). Clark's thesis is that in the 
face of eqUivbcal results in teacher effectiveness studies, 
researchers have bJted either to attempt to' improve arid make more 
rigorous the measUremerit procedures used in the "quantitative" 
studies, or to change the traditional questions of "What works?" 
arid/br "What wbrks with whom?" to the more qualitative questiori of 
"What is happen i rig here arid why?" 
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in one of the first eff5rts to examine specifically the 
intellectual, rather than the observable, behaviors of teachers, Joyce 
^r^^ Harootunian (1964) found that student teachers teaching a science 
lesson had extremely vague and unclear objectives and rarely could 
explain why they had organized the lesson in the way that they had. 
The results of this study led the authors to call for greater emphasis 
in teacher education programs on teaching teachers to be good problem 
solvers and examination of teacher effectiveness in terms of the 
problem solving abilities of teachers: "What is needed is not so much 
an assessment of the way the teacher interacts with children at any 
moment as the intellectual processes which results in that action" 
(Joyce S Harootunian, 1964, p. 420). 

More recently, Shavelsoh and his colleagues at UEbA (Bor.vO, Cone, 
Russo S Shavelson, 1979; Shavelson. 1973,-1978; Shavelsoh S Borko, 
1979; Shavelson, Cadwell, & Izu, 1977), Hunter (1979), Gil (1980). 
Buike (1980) and others have characterized the teacher as primarily a 
decision maker, and they have defined teaching as "the process of 
making and implementing decisions, before, during, and after 
instruction, to increase the probability of learning" (Hunter, 1979; 
p. 62). Shavelson (1973), in fact, calls decision making the basic 
skill of teaching. Others have characterized teachers as information 
processors (Joyce, 1960; Shulman S Elstein, 1975; Vinsonhaler, Wagner 
S Elstein, 1978), as judges (Byers S Lvans, 1980; Glark, Yinger S 
Wildfong, 1978; Floden, Porter, Schmidt, Freeman & Schwille, 1980), 
diagnosticians (Gil, 1980; Gil, Vinsonhaler, & Wagner, 1979; 
Weinshank, 1978, 1980), and planners (Clark S Yinger, 1979; Gil. 
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Hoffmeyer, Van Roekel, & Weinshank, 1979; Shavelson 5 Bbrkd, 1979; 
Weinshank, 1978, 1980; Zahorik, 1978, 1975) • Whatever the term used, 
1t is the thinking and reasoning processes of the taaeher that are of 
interest, 

Clark and Yinger (19791 state, "Mach of what is truly 

professional in a teacher's life is a private process of applying 

theoretical knowledge to particular case problems, and situations" 

(p, 7). Clark and Yinger call for continued research oh teacher 

thinking because they bel-'eve a more public description of the 

processes of teacher thinking majs ^facilitate professional 

commuriicatibh. Rather than thci formulation of general laws of human 

behavior, Clark and Yinger see the main benefit of investigation of 

the mental lives of teachers as being the development of a set of 

concepts useful for '^thinking about* organizing and making sense of 

the classroom world" (p. 7). They call this descriptive type of 

research "conceptual research" as opposed to decision-oriented or 

• conclusion-oriented research. Although research on teacher thinking 

is generally conceived of as descriptive rather than prescriptive, 

Clark (1978) views it as playing a vital role in the application of 

research to practice: 

Research oh teacher thinking is a logical outgrowth cf 
research approaches that emphasize teacher behavior. _ Bu\ 
teacher behavior sensible and effective in one setting may 
be inappropriate in another, and it is the individual . 
teacher who has to define the teaching situation andmake 
decisions about appropriateness.. So if research is to be 
put into practice— if the general case is to be applied in 
particular situations— then researchers mUst know more about 
how teachers exercise judgment, make decisibhs* define 
appropriateness and express their thoughts in their actions, 
(p. 1) 

EKLC 
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The limited hUfflber of studies of teacher thinking have been" 
conddeted almost exclusively in the area of regular education. Some 
of the findings of 'research in regular education very likely are 
applicable in special education; however, the Situation and tne 
constraints operating in special education settings are generally very 
different from regular aducation. For example, special education 
teachers usually deal with fewer students-sometimes instruction is on 
an individual basis. Also, they often mast coordinate instruction 
with another teacher and their instruction may be determined in part 
by that teacher. They generally have much more diagnostic infdnflatlon 
available about a student and must ope'-ate under the conslpints of a 
law that requires a written ^ducational plan with specified goaljp and 
objectives. 

A few investigators have examined decisions made about a student 
before the student actually starts receiving oeeial education 
services (e.g., classification and placement decisions), but little is 
actually known about what happens to students instructional ly once 
they are in special education. Much has been written about 
recomrnended instructional practices of special education teachers, but 
writers generally have not con-.idered whai: it is that special 
education teachers currently are doing and why they are doing what 
tfjey do. Yet, the degree to which teachers are willing to modify 
their practices in response to the suggestions of researchers very 
likely is strongly re:at2d to their current practices and their 
reasons for operating as they are. 

In the present study, learning disabilUies teachers were 
surveyed about their current instructional practices and the bases for 
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these practices. Previous analyses of the data conected (Mirkin & 
Potter, 1982; Potter & Mirkin, 1982) were global in nature and few 
conclusions could be drawn due to the great amount of variability 
present. The current study examined the data more closely to 
ascertain the extent to which relationships between the kinds of 
information used, the types of decisions made, teacher 



characteristics, and student character^istics could be identified. The 



soecific research questions were as follows: 

1. Are specific kinds of infomlation perceived as 
differentially useful in making several different 
types of decisions? 

2. Td.what extent is the use of .different kinds of 
ihfbrmatidna function of individual differences in 
teachers? That is, do different kinds of teachers 
use different kihdr of data in making instructional 
decisions? 

3. fcFwhat extent is the use of different kinds of 
iriformatioh_a function of individual differences in 
students? That is^ do teachers use different data in 
making decisions about different types of students? 

4. Are the specific instructional decisions made a function 
of the type of information used to make those decisions? 

5. Are the specific decisions made a function of teacher 
characteristics? 

5. Are the specific decisions made a function of student 
characteristics? 

7, Is evaluat-'bri conducted during instruction related to 
the likelihood that a teacher will make changes in 
the instructional program? \ , 

Method 

Subjects ^ 

A program planning and implement at ion sur^^vey was sent to 373 
randomly selected me^nbers of the Council for Learning Disabilities of 
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the CiDUncil for Exceptional ehildreh. Of the 373 surveys mailed, 3A% 
(h = i28) were returned completed and 9% (h = 34) were returned blank 
(total return = 43%). Completed surveys were returned by learning 
disabilities teachers in 4? states (21 in the New England region, 51 
in the North Central region, 33 in the South region and 22 in the 
Western region). The responding subjects were distributed fairly 
evenly among rural (27%), suburban (34%), and Urban (28%) school 
districts (unknown = 10%). Most (88%) of the teachers were female, 
almost three-quarters (73%) held at least a master's degree, and the 
average number of years teaching special education students was 6.3 
(range = 1-16; SD = 3.7). Fifty-two percent of the teachers reported 
that they taught elementary school students, 13% said they taught in 
middle schools or junior high schools, and 14% taught in senior high 
school settings. The remaining teachers reported teaching at more 
than one level, taught in unyraded settings such as vocational/ 
rehabilitation centers, or did not report the level at Which they 
taught; Subjects providing direct instructional services (n = 120) 
reported serving an average Of 19.3 students each (range = 1-60; SD = 
9.3; median = 16.7). Fifty-one teachers (32%) indicated that they 
provided indirect service to an. average of 38 students each (range = 
1-1,000; SQ = 133.8; median = 5.2). 

Each teacher was asked to describe the instructional program for 
one student; The averp^e age Of the students whose programs Were 
described was 11.5 years (range ^ 4-18; m = 3;1); Third grade (16%) 
and fourth grade (14%) Were the most frequently reported grades; the 
remaining students were fairly evenly distributed across grades 1-11, 
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with one student in grade 12 and. one in preschooli 9f the 119 
students; whose race was reported, three quarters (76%) were reported 
to be Caucasian, 13?^ were black and 4% belonged to other races. 
Thirty-two percent of the students were reported to have received 
special : education services for more than three years; 30^ of the 
students had received services for one year or less. Thirty-six 
percent of the teachers indicated that they worked with the student 
for more than one year. 

Material s- , . 

A comprehensive program planning and implemeritatipn surjVey was 
developed. This survey was six pages in length and consisted of eight 
sections: (a) school and teacher ihfbnnatibh, fbj student 
ilTformation, (c) selection of lEP goals and objectives, (dT program 
description, (§) determihahts of the program, ff) changes iti the 
original instructional plan, (q) evaluation of progress^ and (h) 
miscellaneous. Items were designed to allow the respbnderilr tc either 
check the answer desired or to fill in a number cbrrespbhding to 
answers listed on an accompanyiiig sheet. Eopies of the data gathering 
fdrms may be found in Appendix A.; 
Prbcedure 

Surveys were mailed to a random sample of ChD members in the late 
spring. For the first 200 surveys mailed, reminder notices were sent 
to thbse who had not responded by the time the second set of 173 
surveys were mailed. Teachers were asked to complete the survey with 
the prbgram of only one of their students in mind. If the teacher's 
caseload was approximately 15 students this student was to be selected 
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aecbfdihg to a random dumber between one s^d 15 assigned to each 
survey. If the teacher did hot have apprdx'imately 15 students oh 
his/her caseload the teacher was to devise a method to randomly select 
a student. In return for completing the survey, teachers were offered 
ah IRbD research report or monograph. 

Because of the relatively restricted sample size and large number 
of specific kinds of infnnnation cited by Vurvey respondents, where 
feasible, items were grouped into categories to make data analysis 
more manageable. Items where responses were categorized included: 
(a) region of the United States (obtained from the code number 
assigned each questiohhaire) , (b) number of years in special education 
(teacher), (e) number of students per teacher receiving direct 
service, (d) student grade, (e) race, (f) year student started special 
education, (g) year the respondent began working with the student, (h) 
level of service student currently received, (i) sources of 
information for long term goals and short term bbaectives, (3) 
influences on decisions about time, materials, methods and 
rnotivaticnal strategies used, (k) type of ongoing evaluation used. (1; 
amount of time service was received in academic areas, (m) type of 
materials, methods and motivational strategies used, and (n) 
Characteristics of and reasons for learning disabilities. The 
categories used and the responses in each category for the above items 
may be found in Appendix B. 

Data analyses . Only first choice responses were used in data 
analyses except for items dealing with the characteristics of and 
reasons for learning disabilities. Chi-square Analyses of frequency 
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data were used to address Research Questions 2-6. Because of the 
large number of chi-square analyses run^ the level of significance was 
set a^ priori at •01. Research Ouestion 7 was addressed through t' e 
use of one-way analysis of variance since both continuous and 
categorical variables were used in the analysis. The significance 
level for these tests was set at .05. 

Results 

The first questibh addressed was "Are specific kinds of 
information perceived as useful in making different types of 
decisions?" Survey responses were examined to ascertain the extent to 
which individual teachers cited the same type of information as being 
the major influence in making different types of decisions. As can be 
seen in Table 1, most teachers 157.8%) were ihcdnsisteht in their 
selection of the type of information perceived as useful in 
determining long term goals and short term objectives. The category 
with the highest degree of consistency across long term goals and 
short term objectives was "Tests" (25.8%). , When it came to 
determining time, methods and materials there was cbrisiderably more 
consistency overall. In this case, corisistehey was defined as items 
in the same category of potential ' influences being selected in at 
least two of the three areas of "time", . "materials" arid "methods". 
Items in the category "observatibh/experienee" were selected by 44.5% 
of the teachers in at least two of the three areas. "Tests" were the 
most favored source of information for 17.2% of the teachers, while 
consultation or constraints were reported iriflueritial in two or more 
areas by 14.8% of the teachers. 
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Insert Table 1 about here 



The data also were examined to determine whether the teachers whO 
relied on one type of informatibh in selecting long term goals and 
short term objectives also relied on that type of information when 
selecting the amount of time services WOUld be provided, the materials 
used, and/or the methods used. Almost 90% Of the teachers reported 
relying On different types of information in making these different 

types of decisions. 

The second research question was "To What extent is the use of 
different kinds Of information a function of individual differences in 
teachers?" The Choices of influential factors in making decisions 
about long term goals, short term objectives, time, methods, materials 
and motivational strategies were examined in relation to geographical 
region of the country, the number of years of experience the teacher 
had in speej^ education and the number of students on his/her 
caseload. Ghi-square analyses revealed no relationships significant 
at the .01 level Or better. 

Research question three was "To what extent is the use of 
different kinds of information a function of individual differences in 
students?" Types Of information perceived by subjects as influential 
in decision making were looked at in relation to characteristics of 
the students whose programs were described. Student characteristics 
examined were: grade, race, number of years in special education and 
level of service received. ' In only one case was a student 
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characteristic related to the type of irifbnnatibn rejibrted as 
influential in making decisions about long term gbals, shbrt term 
bbjectives^ time^ materials, methods or mbtivational strategies. The 

level of service received was related to the type of informatibh 

2 

perceived as useful in making decisions about long term goals (x = 
15.57, £ = .002, Cramer's V = .28). It appears that long term goals 
fbr students receiving minimal special education s§r:^ices (Level I or 
II - mbnitbririg or consultation) are determined chiefly on the basis 
of observational infortnatidn whereas the majority of students 
receiving bevel III services (up to three hours per day) had long h:rm 
goals that were derived primarily from informatian on pupil 
performance oh tests. Teachers of students receiving a greater amount 
of service (bevel IV, V or VI) were divided fairly evenly between 
viewing test informatibh or observational information as most 
influential in determihihg long term goals. Level of service, 
however, like the other student characteristics^ was not related to 
types of informatibh used to make decisions about short term goals, 
time, materials methbds, or mbtivational strategies. 

Research question four was "Are specific ihstructional decisions 
a function of the type of infbnnatibh Used to make those decisions?" 
The responses of the teachers participating in the survey study 
indicated no relatichship between factors said to influence particular 
types of decisions and the actual outcome of those decisions about 
amount of service, materials, methbds and motivational strategies. 

The fifth question addressed was "Are specific decisions made a 
function of teacher characteristics?" Specific materials^ methods and 
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motivational strategies used in reading, math, and spelling were 
examined in relation to teacher characteristics of geographical 
region, number of years of experience in special educati5ri. and number 
of students on their direct service caseload. Chi-square analyses 
revealed no significant relationships between teacher characteristics 

and specific decisions. 

The sixth research question addressed was "Are specific decisions 
a function of Student charateristics?" Materials, methods and 
motivational strategies used in reading, math and spelling were 
examined in relation tc student characteristics of grade, race, year 
the student began special education services and level of service 
received. The only significant relationship indicated that elementary 
and secondary level students were using different types of materials 
in the area of spelling (x^ - 10.03; £ = .607; nramer's V ^ .44). For 
the students in this sample, more than half (51.5%) of those in grades 
1-6 were reported to Use textbooks as their primary material, with 
36.4% relying on ebrtimercial or local program materials and 28.6% 
relying on other materials. In contrast, students in grades 7-12, 
more often were reported to use other materials (50. n«) and less often 
were reported to rely oh textbook materials (2S.0«). 

The last qaestibri asked was "Is evaluation conducted during 
instruction related to the likelihood that a teacher will make changes 
in the instructional program?" Because "likelihood of change" could 
be treated as a continbus variable, one-way analyses or variance were 
used for the statistical analyses for this research question. 

Data for the one-way analyses of variance on types of ongoing 
evaluation in the areas of reading, math and spelling and the. 
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likeliHood of changes in time, mater ialSi methods * and motivational 
strategies are listed in Table 2. Three of the twelve analyses of 
variance were significant at the .05 level or better. 
Student-Newnian-Keuls post hoc tests indicated that in the area of 
reading, teachers Who relied on observatioPdl-type data in ongoing 
evaluation were leSS likely to make changes in materials than teachers 
who relied oh test-based or other types of evaluation procedures. 
Similarly, changes in instructional time in reading were less likely 
to be made by teachers who relied on observational data than by 
teachers who used test-based evaluation. Wh^eh the likelihood of 
making changes in methods was considered, only in the' area of spelling 
was the type of evaluation related to the likelihood of change. A 
Student-Newman-Keuls pOst hOC test indicated that teachers who 
reported using observational and other non-test-based evaluation 
information were less likely to make changes in methods than were 
teachers using test -based evaluation ap roaches. 



Insert Table 2 about here 



Discussion 

In this study, data gathered through comprehensive surveys of 
Special education teachers serving learning disabled students were 
examined. The goal of this examination was to identify any 
relationships between teacher or student characteristics and specific 
instructional decisions made. Or between teacher or student 
Characteristics and the factors perceived by the teachers to Influence 

o 
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those instructional deeisibhSi It was found that the teachers 
generally did use different types of infomiation in making different 
kinds of decisions; However, except fOr the finding that the teachers 
who relied on test -based information in their ongoing instructional 
eva-Mations were more likely to nafce program changes than were the^ 
teachers who primarily used observational information, no 
relationships were found between teacher characteristics and specific 
decisions or factors influencing decisions. Likewise, the only 
findings relating to student characteristics were in regard to grade 
in school and Spelling materials and in regard to level of service and 
infonratibh USed in determining long term goals. When it is 
considered that 136 statistical comparisons were examined, the fact 
that so few relationships between variables were found is in itself 
significant. the findings of this study of Special education 
teachers, then, are consistent with studies of regular education 
teachers which have found much variability, ribh-pf edictabil ity, aid 
complexity in decision behavior (e;g;, Bawden, Buike, S Duffyi 1978; 
6i1, Hoffmeyer, Van Roekel, S Weinshank, 1979; Mbrine, 1976; Yinger, 
Clark, & NIbhdbl, 1980). . 

In any survey research, consideration must be given to bias in 
the results due tO differences between those who db respond and those 
who do not respond to the survey. In this case, those who responded 
were those whb were willing to spend up to an hour or more completing 
a detailed six page questionnaire. These were alSo teachers willing 
to share informatibh on how they teach; While the teachers were asked 
to make a random selection of a student from their caSe load whose 
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program they would describe, it is likely that if the student was hot 
selected randornlyj the student who was selected would be brie that the 
teacher felt was a typical LD studerit, had a typical iristructibrial 
program, or had a program that the teacher warited to use as a best 
case example. 

surveys were sent only to members of a professiorial brganizatibri 
specifically focusing on the education of learrifng disabled studerits. 
Since members of this organization regularly receive professiorial 
literature, it is likely that the subjects in this study are more up- 
to-date on professiorial approaches than many nonmember teachers. 
Furthermore, these were experienced teachers; they had taught special 
education students for ari average of over six years; The vast 
majority of these experiericed teachers apparently believed that they 
had found effective ways to instruct learning disabled studerits; Iri 
fact, 93% of the teachers Indicated satisfaction with t^e methods used 
to teach the target studerit arid 84« indicated, that they felt the 
student was makirig satisfactory progress (Mirkin & Potter, 1982); The 
sample of instructional programs upon which this study is based most 
likely is biased, but it UridbUbtedly is biased in the direction of 
best practice rather thari worst practice, thus, iri a study examiriirig 
instructional decision praetiees and instructional programs for a 
specific group of students (those Identified as learning disabled! , a 
study biased toward best-case examples, there is overwhelmingly more 
variabili'cy than commonality in both the instructional programs and in 
the type of information used iri ehbbsing thi instructional programs; 

The cognitive processes of teachers began to interest educatiorial 
researchers when the search for correlates of eff ectiveriess amorig 
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teacher personality characteristicsi specific teaching methods or 
materials yielded only equ^" ocal resalts. The assumption in the 
examination of cognitive pi ^cesses is that it is the cognitive 
behavior of individual teachers that determines the instructional 
process used with a Student and that if this cognitive behavior can be 
understood, characteristics of effective teaching may be identified. 
The ultimate goal Of research on teacher effectiveness logically is to 
find ways of improving effectiveness. What many teachers and teacher 
trainers would like iS an "effectiveness cookbook" that is, "if you do 
X, y and z you will be an effective teacher." Yet, as Glass (1983) 
points out, the eobkbOOk approaches tried to date have only been 
spectacular in their great varibility in effects from study to study. 

He concludes that. 

In the behavioral sciences and education we possess a few 
ge n era l intervehtionS of verified effectiveness ... that 
produce moderate benefits on the ave^-age , but benefits _that 
vary greatly (from ineffective to very effective) in a 
manner that is essentially unpredictable (p. 77) 

What about judpent theory* decision theory, problem solving 

theory - cannot any or all Of these be usefully applied toward 

Characterizing educational decisions? Perhaps they can; hOwever, 

success in research along theSe lines to date has been less than 

encouraging (see for example Yinger, Clark, and Mondol's, 1981, 

application of a policy-capturing model). Researchers who try to 

^ apply theoretical models often end up combining components of 

different theories in ah attempt to represent adequately the decision 

processes they are studying (e.g., Elstein, Shulman, & Sprafka, 1978; 

Olshavsky, 1919; Payne, BrauhStein, & Carroll, 1978; Shavelson, 1978). 
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While to be totally atheoretical might avoid of the hazards of trying 

to fit complex data to imperfect models, the benefits of the 

organizational structures of the models are lost. Like Tversky and 

Kahneman's (1974) decision heuristics, although models can lead to 

severe and systematic errors, on the whole they can often be useful in 

guiding research. One ,lust must realize that models are frequently as 

much a product of historical accident as they are a product of 

verifiable data. Edwards (1971) proposes that had Egon Brunswik known 

the Bayesian ideas of probability theory when he was looking for a 

method of examihirig a fallible prdbabalistic environment, he may well 

have adopted that approach rather than focusing on the use of 

correlational statistics. Feigl (1955) also addressed the arbitrary 

nature of models in a response to an article of Brunswik's (1955) 

which had outlined the Bruhswikian ideas of design and theory in 

functional psychology: ^ \ 

Brunswik knows, perhap§ better than ariydhe elsei that the 
subject matter of a science can be "carved ou^" in a number 
of ways. Ultimately there is inly one Criterion by which 
scientists decide which ways of "focusing" are preferable: 
"By their fruits ye shall knew .them." But what sort of 
fruits are desirable depends bri one's interests, (p. 233) 

Up until this point i.h time, the harvest of "fruits" derived from 

the application to eaucation of any of the theories of reasoning has 

not been large. However, it is questionable whether educators could 

even agree on what fruits are desirable. Before it can Ue detennined 

how to make instruction more "effective," educators would have to 

agree on what "effective" means. The teachers in the present study 

almost universally seem to believe that the instruction they are 

o 
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providing is fairly effective. Yet, Glass (1983) puts forth 
overwhelming cb^ective evidence that certain kinds of special 
edaeation programs are riot effective. Rather than automatically 
assuming the supremacy of objective research data over subjective 
teacher reports, perhaps it is the definition of "effective" that 
needs to be examined. to a teacher, an instructional prcnram 
generally is considered effective if the student is learning what the 
teacher believes the student should be learning. The studies Upon 
which Glass bases his conclusions are experimental comparison studies 
where effectiveness is defined in terms of the test performance of a 
treatment and a control grOUp. A student's program considered 
effective according to one definition, may not be considered effective 
by another definition. 
Recommen d at ions fo r Future Research 

A top IBM research scientist Was given a company fellowship a few 
years ago to work on relating his expertise in computer memory to the 
workings of the human mind. "'I couldn't hack that one at all,' he 
isaidi. 'I went back to silicon technology. "' (Pauly & LuBehbw, 1983, 
p. 58) Perhaps in education we, too, need to pull back oh attempts to 
fathom the complexities of human cognition. Rather than trying to 
find comnonalities between teachers, it may be more profitable at this 
point in time to recognize the uniqueness of each teacher and each 
teacher-pupil relationship. It may, however, be useful to help 
teachers think about arid become consciously aware of how they do make 
instructional decisions and to expose them to alternative practices. 
Knowledge of the materials arid techniques of education and knowledge 
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of the currently understood processes of decision making need to have 
joint emphasis in teacher training and iriservice programs. By 
understanding some of the principles of suCh thinqs as bounded 
rationality, problem definition, decision hsjristics and ^planning 
models^ teachers might be able to define problems more easily* 
identify alternatives and then choose among those alternatives. 

Educational "cookbooks" may prove useful in organizing the 
massive amount of informational content that currently exists arid is 
ebhstahtly expanding in education. However, to rely on ^ "cbbkbOOk" 
to make decisions r<ither than to provi de i nf ormati o jl fjar decisions is 
to ignore the apparent uniqueness of each teacher-pupil instructional 
interaeti bh. 

Efforts to imjarOVe the effectiveness of educational programs heed 
to continue, but Since situational constraints and educational 
philosophies vary greatly from school to school, it may prove rnOre 
practicable to base evaluations of "effectiveness" on local rather 
than general definitions Of what constitutes an effective educatibhal 
program. Rather than searching for universal truths, research efforts 
could focus oh helping individjal districts determine criteria for 
effectiveness, ways bf evaluating whether their teachers are being 
effective, arid ways bf helpirig the teachers to be effective; 
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Table 1 

Consistency in Types of Factors 
Perceived as Influential in Decisions 



Type of Decision 

Goals and Time ^ Across 

Objectives Materials, Methods all Areas 



Category 


n 


% 


n 


% 


n 


% 


Tests 


33 


25.8 


22 


17.2 


7 


c 

5.5 


dbservati on/ 
Experience 


15 


11 .7 


57 


44.5 


4 


3.1 


Consul tat ion/ 
Constraints 


6 


4.7 


19 


14.8 


2 


1 .6 


No Consistency 


74 


57.8 


30 


23.4 


115 


89.8 
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Table 2 



Bne-Hay fthalysis of Variance: Likelihood of Changes by Evaluation Conducted During Instructioii 



Time 



Math 
Spelling 



Tests 

t sa 



Observation 
J SD 



Other 

! SD F Ratio FProb S-H-K 



2.71 




44] 


2.23 


.77 


1351 


2.43 .81 3.40 


2.57 


.81 


38 


2.33 


.80 


(37 


2.22 .82 1.87 


2.54 


.86 


|52' 


2.40 


.91 


(191 


2.32 .67 0.39 



0.16 



Reading 
Math 

Spelling 



Reading 
Math 



Reading 
Math 

Spelling 



3.16 


.58 


m 


2.64 


.84 ' 


(35) 


2.97 


.62 


5.36 




3.10 
3.18 


.54 


m 


2.79 


.74 


(37) 


2.94 


.62 


1.53 


m 


.59 


(52) 


2.86 


.77 


(19) 


2.84 


.69 


1.72 


0.18 


3.00 
3.10 


.58 


m 


2.68 


.83 


'(35) 


2.83 


.62 


i.88 


0.16 


.54 


(38) 


2.87 


.70 


(37) 


2.76 


.64 


i.84 


d.ie 


3.18 


.66 


(52) 


2.79 


.70 


(19) 


2.63 


.83 


3.42 


0.04 


3.06 


.81 


m 


2.93 


.87 


(35) 


2,83 


.66 


0.72 


0.49 


3.10 


.89 


(38) 


3.03 


.85 


(37) 


2.34 


.69 


0.85 


0.43 


3.27 


.77 


(52) 


2.92 


.81 


(19) 


2.79 


.63 


2.32 


0.10 



3,1>2 



ERIC 



APPENBIX A 

Prdgram Planning and impTenrentat ion Survey 



33 



ERIC 



A-1 

PROGRAM PLANNING AND DffLQffiNTATlbN SURVEY 



PART A 



SCHOOL AND TEACHER INFORMATION 



Type of School: Rural ^Suburban |Urban 

^Elementary M iddle/ Jr> High S econdary/Senior High 

Teacher Ihf brmatibh: F emale M ale 

How many years have you taught Special Education students? 

Please identify the highest degree you hol d 

Approximately how many children do you serve each day? 
Number served: D irect service indirect service 



FoT the reTrtxifidei' of the 8wn>e2j^ respond t^^ in mind the 

program of the Btudent selected according to the attached directzons.^ 



PART B I STUDENT INFORMATION 

1. For this particular student: Age Grade ___Race 

2. Month and year Special Education service began 



3. Month and year you started working with this student 

4. Date the current Individual Educational Plan (lEP) was written ^ 

5. Date of the last lEP periodic review^^^^^^ ^ 

6. l^Jhat level of serHrlce do ydii provide this student? Circle one. 

-Level: 

I - Mohitorihg iV - Direct service - more than 4 hours/d 

ii - Cdtisulcation V - All day, self-contained 

ill - Direct service - up to 4 hours/day VI - Special Schooi/Residential 

7. How much Special Education service does this student receive 3:n the following 
areas: 

Areg » Min/day gPays/wk Area if Mj . n/day ^ays/wk 

Reading . Written tanguage 

Math ^ Other > 

Spelling , (Specify) : — 

8. What are the criteria for a student to be classified as learning disabled 
in your school/district? 
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A- 2 



-p^^lcl l SELECTION OF tEP GOALS «ID OttJEeTiVES 



?H u grg not V 



)::Zv ed in writvn^ 



±Jiia pa rt and gg . 



respond to the liaising questvona. Please raxxK or a 

u feel were the moVr: important in detemining - 



tc? least 



What sources of informatibn do yo 

a. Loisg term goals: 

Item a t -» — — 



If "Other," ^19. was used, please specify:. 



b« Short tens objectives: 
Item 9- 



I£ "Other," #19. was used* pleaue specify: 



PAPT D I program' description 



1. 



. A Kslow check whether the instruction you provide 



Area, 

Reading 
Manh 
Spelling 



Xti^ace of ypfilementanr 



Written Language 

Other 

(specify) :^ . 



T.. ptace of g^iffllemeptai 



Spelling ~ • t t"dn 

, „X^-risk (*) the rnater-LaU method, r,^mzi^lu within each aaademtc 

^iS^stJ^nt. Check VJ) anyth^ else used ve^larly 

area. 



2. Material 

Child's classroom text 
Other standard texts 

CoSercial programs 

Locally developed 
programs 

Consumables 
Mahipulables 

Other (specify):. 



Reading Math S£ell4tt£ Other 



DISTAR, Frostig* KeyMat^ 
Math/reading programs - 

Workbooks, worksheets 
tuisinaire rods, fian- - 
nel board 
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3. Method 



ERIC 



Work oil sub skills 
Practice 

Modality training 
Modeling 



Gaines and 
machinery 

Other (^specify): 
4, Motivation 



Regroaping in sub- 
traction 
Syllabication 
Comprehension skills 

Oral reading practice 
Writing times tables 
isolated word practice 
Writing in journals 

VACT (visual, auditory 
kinesthetic, tactile) 

Student listens to selection 
before reading 
Student reads while teacher 
reads 

Student imitates solving of 
math probl^ 

Tape recorder 
Language master 
Computer ganies. 



Examples 



Re a d i n g Math 



SOellihg Other 



Reading Math Spelling Other 



Social reihfbrcers 



Activity reiiifdr- 
cers 



Concrete rein- 
forcers 

indirect reih- 
f orcers 

Contracts 



Se If -management 
strategies 



Funishmeht 
procedures 



verbal praise, posted 

praise, working with friend, 
positive note home 

Use typewriter^ have free time 
have early dismissal^ be office 
assistant, do favorite school 
work 

Candy, stars* stickers, money 
school materials 

Earn points i tokens i check- 
marks, etc. , to trade in 
a reinforcer 

BetWera student and teacher; 
between student* teacher* 
and patent 

Having student charting his/her 
own data; scoring his/her own 
tests; self -monitor ing of time 
on task 

Time out, response cos 0^ error 
correction, sad faces, red 
checkmarks, fines 



Other (specify) 
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Over^ please 



A-4 

IpART E \ DETERMINANTS OF THE PROiSRAM 



Use the iterrm tlsted in SecHor^ of the blue foim ^'^^"^ 
ques^J^ rkfc ord^r your an^^ from most inportant to least vmportant. 

What factbis have been most influentiai in determining - 
a. The amount of time the student receives services: 



Item #- 



If "Other," #23, was used, please specify:, 

b. The materials used: 

item ^ t 

If "Other," # 23, was used, please specify: 

c, the methods used: 
Item 9 



If "Other," ? 23, was used, please specify:; 
d. The motivational strategies used: 



Item 



If "Other," # 23, was used, please specify :_ 
PART-^ CHANGES IN ORIGINAL INSTRUCtlONAi PtAN 



tional strategies.) ^ Very 

Uniikciy Unlikely Likely Likely 



1 
1 



2 :i 4 

2 3 6 

2 3* 

2 3 * 



Chaage materials 
Change methods 

Change motivational strategies 1 
Change time allocation, student/ 1 

ceacher ratib» etc. • ; : 

Generally, what is the basis for your decision to ^ke changes, or hot make 
changes, in this student's program? Rank order, please. 

^objective performance data 

p ersonal oBservatibn of student progress 

external constraints ^scheduling, changes in classroom curriculu». ecc) 



_^ocher (specify) : _ 
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I PART G i EVALUATION OF PROGRESS 

Use the iieim listed In Seaiioh G of the blue form to respond to question 2; 



i; 



What, if any, type of evaluation information do you collect in each of the 
areas in which you provide instruction? Please rank order your answers 
froffl most important to least important and indicate the f requeney with which 
yoa use each form of evaiuafcion ^e^g.^ daily* 2X/week, monthly, etc.) 



Are a 



Reading 



Hath 



Type of Evaluation 
(tist item #) 

1. 



Frequency 



Spelling 



Written Language 



Other (specify) 



2.. 
3.. 

l._ 
2.. 
3., 

1. _ 

2. _ 

3.. 

1... 

2.. 
3.. 

±., 

2.. 

3; 



i 



2. 



Where do you record information about this student's perf ormance/progress? 
No written records kept C hecklists 



jCharts ahd/br graphs 



^rade book 



rile samples of work 
Other (specify ) - 



3. Of the total amount of instructional and preparatory time devjted to this 
student, what percentage would you estimate you spend in performance/ 
progress evaluation activities? Circle one; 

up to 10% 11-26% 21-30% 31^5% 46-60% 61-75% iSre than 75% 
Under ideal conditions, would you like to see this percentage of time: 
^increased stay the same ^ d ecreased 
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Over, please 



- mi^m^^^ ^ ^^^^^ 

frequency of each use. frequency 



J[6t iised 

Discuss progress with student 
Discuss progress with parent 
Discuss progress with regular classroom 
""teacher 

-jConsttit with lead teacher^ prtocipal* 
'^special education director, etc. 

Send notes hom^ 
jEhahge instructional plan (materials, 

methods » etc.l 
-Decide when to review, reteach 
_Mbhitbr progress on lEP goals and objectives 

Review progress with team 
-Modify iEP goals and objectives 
^Assign grades 

Other ?«pgcj-fvV> . 



I PART H_l MISCELLANEOUS 

1 How satisfied are you with this student's program in terms of: 

VeryDis- Dlssat- Satis- "^f^ 
satisfied isf ied fled isf ied 

, 2 3 4 

a. Materials available l 

b. Amount of instructional _ ^ ^ 
time ^ 



2 
2 



2. 



c. Methods you are using 

d. Ability to monitor 
progress ^ ^ ^ ^ 

e. The student's progress 1 ^ - 

, 1 T>i» iower student /teacher ratio 

The instructionai approach The lower 8tu«c / 

""used Increased student motivation 

the nace^iai used Abtiity to closely monit5r student 

i ^^5greS8 and isake changes when 

^the additional instruction - aid 

time spent in target areas neeaea 



3. 



_ t_ ^ i-'r^o oiirv^v or' the instructibhai or 

We welcome any comments you have on tais survey or i:ne 

evaluation process in general. 
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Ui0 m fptt&Hn^ iteirm ir roBpmding to qucaiicna in Fdx^C^ ofJIiM saxwp. ^ 

thM ••etioni on this fom ax^ led to edin^spond ^ih the^ poTtxon of^the Bum>ey 
tfetfi item are appropriate, rncse liete ure bu yto means, e^auatvve. PUaae reelj^e_^ me 

jxiOgory 'Vi^er''i m ^t ask thai you apeoify what "other'' etrnda^ for vn the appropriate 
epaee an the euruey ii ^ 



Sec tioa C 



Sources of tnforxbatlon 



i. Overall scbrei on ability costs 

?• Oy«F*y- achievement tests 

3i Pattern of scores on ability tests 

5. Pattern of scbrei on achievement tests 

5. Discrepancies bctveen ability and 

achievement tests 

6. Other standardized assessments 

7. Performance on critiridh-' referenced 

measures 

8. Progress on previous ISP objectives 

9. Informal assessments done during 

previous ihstr**ctibc 

ID* Other informal assessmcmts 



16 i 

17. 
18. 



19; 



- - _ - ■- 

Personal observation of studMt per 
Behavioral observations/information 



li. 

13; Classroom teacher's priorities 

14. Parental input/priorities 

13. Input of other team members 



Constraints ©f times, materials, teachers 

available- 
District policies _ - _ 

X coflwerclal or locally constructed lift 

of iong-tern goals, »tort-ter« obJ«ctlv«s^ 
and/br Ihstrueclonal suggestions 
Other 



I Section E j 



Influential Factors 



2. 

5. 

S. 
7, 



9. 

ib« 
11. 



Demonstrated ability on psychological 
testi 

Performance on standardized tests 
Performance on informal measures 
Formal observation 
Medical information (hearing, 

medications, etc.) 
Family information 

Referring teacher's statement of 

original referral problem 
ClassrooQ teacher's comments on 

.classroom progress 

Classroom ceacher's requests 
Material covered by regular 

classrbba 

Student charaeceristlcs (e.g.t 
attention span^ mbtivatioh, 
social skills, etc.) 



12. Past experience with student 

13. Past eacperlence rflth students with similar 

problens 

14. Materials- available 

15. tour ca8elbad_ 

16.. Rest of student's schedule 

17. Other students taught at same tlffle_ 

18. Pblicy bf lead ceacher /school/district 

19. instructor's guidc(s) for text (s) 

20. Consultation with bthers (aside from class- 

_^Pom teaches and parents) 

21. Parent requests _: 

22. College cbursev2rk, pro fessionAl Journals » 

workshops^ «tc. 

23. Other 
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Types of Evaluation 



1. Standardized achievement tests 

2 . S tanda.r diz ed _ diagnbs t ic measures 
3; District developed tests 

4. Basal text mastery tests 

5. Criteribn referenced measures 

6. Direct and frequent measurement 

(precision teaching- type) 

7. Teacher-made tests/oral quizzes 

g. Scoring workbooks 

9. Scoring worksheets 

10; A2SDUQt of work completed 



U. Homber of correct flashcards ^ 
12. tlitening to oral rsading 

13; Oral, sllrat timings _ 

14. informal observation bf studeac performance 

15. Fo™*l_o^iervatloa 

16. Consultation with classrpbm^eacher 

regarding classroom performance 

17. Check number of short-term objectives 

mastered - 
18; Other 

b 
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APPENDIX B 
Gategbrizatlbri of Data 




ERIC 



Cdnnecticut 
flaine 

Massachusetts 
New Hampshire 
New Jersey 
Hew York 
Pennsylvania 
Rhode Island 
Vermont 

itorth Central 



Illinois 
Indiana 
Iowa _ 
Kansas 
Michigan 
Minnesota 
Missouri 
Nebraska 
North Dakota 
Ohio _ 
South Dakota 
Wifxbhsih 



oris of the United States 

South 

ftlabama 

Arizona 

Delaware 

Florida 

Georgia 

Kentucky 

bouisiana 

Maryland 

Mississippi 

West 



Alaska 

Arkansas 

California 

Co lor add 

Bawaii 

Idaho 

Montana 



North Carolina 

Oklahoma 

South Carolina 

Tennessee 

Texas 

Virginia 

Best Virginia 

District of Columbia 



Nevada 
New Mexico 
Oregon 

Utah 

Washington 
Wyoming 



Note. Based bh the regional breakdown used by the U.S. Census Bureau. 
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B-2 



Number of Years Respondent has 
Numbe r of Years 
1-2 

3-5 _ 
More than 5 



Taught Special Education 

Category 

Inexperienced 

Wbder ate 1 y exper i enced 

Very experienced 



Number of Students Per Teacher Receivin., Direct Service 

Number of Students Category 

1^15 g 

16^25 J 

More than 25 C 



Student Grade in School 

Grade EategOi y 

|_5 Elementary 

j_l2 Secondary 



Race of Student 

Race ^^ategbry 

Caucasian Caucasian 
Black, Hispanic Minority 
Native Americani 
Other 



ERIC 



Year Student Started Special Education 
Year ' C ategory 

1972-1976 I 
1977-1979 I 
1980-1981 C 
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B- 



Year Respondent Began Working with Student 
Year -Category 

1973-1979 A 
1980-1981 B 



Level of Service Student Currently Received 
4eve^ Category 



I. II 
III 

IV, V, VI 



Minimal Service 
Resource Room 
Majority Special 
Education 



Amount of Time Service Was Received In Academic Areas 
Mlautes per Pay Category 



1-lS 

16-45 

More than 45 



A 

D 
C 



Materials Used In Instructing Target Students 
Mater4^ Category 



classroom texts 
other t^ts 

confiiercial programs 
local programs 

cohsuinables 

mah1pulai)les 

other 



texts 

programs 

other 
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B-4 



Methods Used in Instructing Target Students 

Mg^■^1nd Category 

subskills sdbsRills 

practice. practice 

modality training other 

modeling 

games and machinery 



Motivational Strategies Used in Instructing Target Students 

Motivation Category 

social reinforcers soctal 

activity riinforcers reinforcers 
concrete reinforcers 
indirect reinforcers 
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Characteristics of hearriirig 
Cat egory 

A) Neurological/Within Child 

B) Motivation 

C) Academically oriented 

Reasons Why Some Children 
Category 

D) Within Child 

E) Environmental 



B-5 



Disabled Students ^ 

Examples of ResponsBS^ 

prbces s i rig7memory d i f f i cu 1 1 i es 
atten t i bna 1 _ pf bb 1 ems 
distractibtlity 
perceptual /mbtbr problems 
brganizatibnal prbblems 

motivational problCTS 
social/behavioral prbblems 

poor academic achievement 
need for special program 
abtlity/achievement • 
discrepancies 



are Learning Disabled 
Examples b f^ Reasbris 

heredity 
faulty^wiring 
genetic 
brain injury 



poor teaching 
environment 
learned behavior 
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B^6 



Catcgbrlzatlon of Response Choices for Survey Parts C, E and G 



SOURCES OF INFORMATION FOR LONG TERM SOAtS AND SHORT TERM OEJECTIVES 



tests 

Overall scores on abilltiLtcsts 
Overall scores on ac hi eveinent_ tests 
Pattern of scores on ability tests 
pattern of scores bnachlevement tests 
Discrepancies between ability and 

achievement tests : 

bther^tandardlztd assessments ^ 
Perfomance on critarlbh-refcrenced 

iseasarcs 

bbservattot-b f Perfbrm anee 

Progress on previous lEP bbiectlves 
InforSal assessments dent during 

previous J^nstnjct1on_ 
Other Infbnnal assessments . 
Personal observation of student 

perfbrmanci — 

Behavioral bbservations/lnformatlon 



CdhsuUatlbh/C bnstraints 

Cl assroom teacher • $_pr 1 of 1 t1 es 
Parental 1nDUt/priorit1e$__ 
Input bf bther team members 
Constraints of times, materials, teachers 
_ available 

District policies . 

A coBirtercial or locally constructed list 
of long-term goals, short-term objectives, 
and/or instructional suggestions 



INFLUENTIAL FACTORS 



Test Based and O bj e c tive Information 

O«noh$trated ability on psychological 

tests _ _ _ ^ 

Performaoce on standardized tests 
Performance on_ informal measures 
Fdrtnal bbservation 
Medical Infbrmatibn (hearing, 

medications, etc.) 

E xp e r 1 cht 1 a 1 -Fae tors 

Student characteristics (e.g.. ^att^^^ 

Spain, •otlvation^ spcial skills, •tc) 
Past experience with student, . 
Past experiehce with students with similar 

problems -,j 

College coursewprk. professional Joarnals. 

wbrkshbps. etc. 



Consul t a t i^/^ Constraints 

Materials aynilable 

Your caseload _ 

Rest of student's schedule 

Other students taught at same time 
Policy of lead teacher/school /district 
Instructor's guideU) for text($) 

Family Information . * ^ 

Coosu1tation_w1th others (aside from classroom 
_ teacher and_parehts) 
Parent requests 



TYPES OF EVALUATION 



fefiMl Tests 

Standardized achievement tests 
Standardizeddlagnostlc measures 
District developed tests 
Basal tixt mastery tests 
Formal bbservltibn 

Informal Tests 



Criteribh referenced measures 
nirectand frequent measurement 
- (precision teaching-type) 
Teacher-made tests/oral quizzes. 
braU snent timings - 
Check nwnber of short- term objectives 
mastered 



tonsultation 



Scoring workbooks 
Scbring_wbrksheets 
Amount of work_cpmpleted ^ 
Number of correct flashcards 

Listening to oral. reading _ 

Informal bbservation of studentperfprmance 
Consul tatipn with classroom teacher regarding 
classroom performance 
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